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(57)Abstract: 

PROBLEM TO BE SOLVED: To prepare picture data 
with a watermark expressing a color picture with a 
watermark by converting color picture data of a first 
color system to a second color system and inverting 
color picture data of the obtained second color system 
to the first color system through the use of an inversion 
matrix. 

SOLUTION: In embedding a watermark to an original 
picture P, a mark picture M including a watermark to be 
embedded is prepared in addition to this picture P. This 
picture M is a binary picture and is converted from an 
RGB color system to a YCbCr color system first. A pixel 
at a position equivalent to the effective area of the 
watermark is converted by using an embedding 
conversion matrix obtained by adding an original 
conversion matrix and a watermark matrix. At the time Hl " 
of executing it concerning all the pixels, YCbCr picture 
data F with a watermark embedded with a digital 
watermark is obtained. At the time of operating an 

inversion matrix with respect to this YCbCr picture data F with watermark, RGB picture data P, 
with a watermark are obtained. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] It is the digital-watermarking method characterized by providing the following of 
spacing through a color picture and performing embedding of a mark, (a) A transformation matrix 
which changes color picture data of the 1 st color coordinate system into color picture data of 
the 2nd different color coordinate system from said 1st color coordinate system, A production 
process which sets up an augmented matrix from which a production process for which an 
inverse transformation matrix which performs inverse transformation of said conversion is 
prepared, and (b) real number value x and -x are used as a component, and the sum of each line 
and a component of each train serves as abbreviation 0, (c) A production process which creates 
a transformation matrix for watermark embedding by adding said augmented matrix to said 
transformation matrix, a production process for which a watermark mark embedded in the (d) 
color picture is prepared, and a pixel equivalent to a location in the (e) aforementioned 
watermark mark A production process which changes color picture data of said 1st color 
coordinate system into said 2nd color coordinate system using said transformation matrix for 
watermark embedding (f) A production process where said watermark mark was embedded by 
transforming inversely color picture data of the 2nd color coordinate system acquired by said 
conversion to said 1st color coordinate system using said inverse transformation matrix, which 
spaces, is attached and expresses a color picture and which spaces, is attached and creates 
image data A preparation and said production process (b) are said real number value x. A 
production process which adjusts visibility of said said watermark [ in / it is spaced and attached 
and / a color picture ] mark by adjusting at least one side of the arrays of each component in 
said augmented matrix 

[Claim 2] Adjustment of said visibility is the digital-watermarking method performed by setting 
said real number value x as a different value from other mark groups in some [ at least ] mark 
groups of said two or more mark groups including two or more mark groups from which it is the 
digital-watermarking method according to claim 1, and said watermark mark was separated 
spatially mutually. 

[Claim 3] Adjustment of said visibility is the digital-watermarking method performed by setting it 
as a value which is [ in / while it is the digital-watermarking method according to claim 1 and 
said watermark mark includes a mark field which consists of pixels which continued spatially, said 
mark field is classified into two or more partition fields, and / some / at least / partition fields of 
two or more of said partition fields ] different from other partition fields in said real number value 
x. 

[Claim 4] It is the digital-watermarking method performed when it is the digital-watermarking 
method according to claim 1 and adjustment of said visibility replaces the trains or lines of said 
augmented matrix. 

[Claim 5] A digital-watermarking method characterized by providing the following It is the digital- 
watermarking method according to claim 1, and sets to said color picture with a watermark, and 
when said watermark mark can check by looking with the naked eye, said method is the product 
of the (g) aforementioned inverse transformation matrix and said augmented matrix further. A 
unit matrix which has a degree equal to said transformation matrix A production process for 
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which an invisibility-ized matrix which is an inverse matrix of **** is prepared (h) A production 
process at which visibility of a watermark mark in which said check by looking is possible is 
reduced in a pixel equivalent to a location in said watermark mark by [ said ] spacing, being 
attached and making image data operate said invisibility-ized matrix 

[Claim 6] It is the digital-watermarking method which is the YCbCr color coordinate system by 
which it is the digital-watermarking method according to claim 1, one side of said the 1st and 
2nd color coordinate system is an RGB system of color representation which consists of three 
chrominance-signal components showing three primary colors of light, and another side of said 
the 1st and 2nd color coordinate system is constituted from a luminance signal and two color- 
difference-signal components. 

[Claim 7] It is the digital-watermarking method including a production process which performs 
underflow amendment and overflow amendment so that it is the digital-watermarking method 
according to claim 6, and said production process (f) may face image data of said YCbCr color 
coordinate system acquired by conversion by said transformation matrix for watermark 
embedding transforming inversely to said RGB system of color representation using said inverse 
transformation matrix and each pixel value in image data of said RGB system of color 
representation may turn into an integral value of a predetermined range. 
[Claim 8] It is the digital-watermarking method that it is the digital-watermarking method 
according to claim 1, and said real number value x is a value of about 0.01 to about 0.7 range. 
[Claim 9] It is the record medium which recorded a computer program for spacing through a 
color picture and performing embedding of a mark characterized by providing the following and in 
which computer reading is possible. A function to set up an augmented matrix from which a real 
number value x and -x are used as a component, and the sum of each line and a component of 
each train serves as abbreviation 0, A transformation matrix beforehand prepared in order to 
change color picture data of the 1st color coordinate system into color picture data of the 2nd 
different color coordinate system from said 1st color coordinate system, A function which 
spaces by adding said augmented matrix and creates a transformation matrix for embedding, and 
a pixel which was beforehand prepared using said transformation matrix for watermark 
embedding and which spaces and is equivalent to a location in a mark A function to change color 
picture data of said 1st color coordinate system into said 2nd color coordinate system A 
function which spaces, is attached and creates image data for said watermark mark to have been 
embedded by transforming inversely to said 1st color coordinate system using an inverse 
transformation matrix beforehand prepared in order to perform inverse transformation of 
conversion according color picture data of the 2nd color coordinate system acquired by said 
conversion to said transformation matrix and to space, and for it to be attached and to express 
a color picture A computer program for realizing a computer is recorded and said augmented- 
matrix setting up function is said real number value x. A function to adjust visibility of said said 
watermark [ in / it is spaced and attached and / a color picture ] mark by adjusting at least one 
side of the arrays of each component in said augmented matrix 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to the digital-watermarking 

technology which spaces through a color picture and embeds a mark electronically. 

[0002] 

[Description of the Prior Art] With development of computer networks, such as the Internet 
informational digitization progresses and the information which many users need simply can be 
accessed now. It is becoming the environment which refuses the author and can reproduce data 
easily [ there is nothing and ] on the other hand about the digital content which copyright has 
generated in the digital information, and the problem of the literary piracy accompanying an illegal 
copy has attracted attention. Then, the digital-watermarking technology which embeds 
watermark information, such as copyright information, to the data of a color picture for the 
purpose of preventing the literary piracy about the color picture which is the main information on 
a digital content etc. attracts attention. 

[0003] About this conventional kind of digital watermarking, many technical proposals are made 
to the shade image. Since considering the brightness component (Y component) it can treat 
about a color picture as well as a shade image, the technique of embedding digital watermarking 
for the brightness component corresponding to a shade image has been used 
[0004] 

[Problem(s) to be Solved by the Invention] However, most proposals which are going to use the 
signal and data of a proper for a color picture, and are going to embed digital watermarking are 
not made, "depths information record of a color picture" (the **** society — ) which used the 
color space of a color printer as digital-watermarking embedding technology The collection of 
annual meeting drafts, 7 and 20, pp.47-48, "a way method of the color watermark in 
consideration of a vision property" (IMPS 97, 1-3.14, pp.45-46 (1997)) of model style molding 
which used the vision property skillfully, "A way method of the digital-watermarking embedding 
to a digital image" (SITA 97, Vol.2, pp.541 -544 (1997)) is proposed. Such technology has a 
complicated model and has the weak spot where pad processing of a watermark is not easy. 
Moreover, degrading the image quality of a color picture was also pointed out by the method of 
embedding a watermark at the lower bit of a color picture. 

[0005] This invention aims at offering the digital-watermarking technology for spacing through a 

color picture using the property of a proper, and embedding a mark. 

[0006] 

[The means for solving a technical problem, and its operation and effect] In this invention, the 
transformation matrix which changes the color picture data of the 1st color coordinate system 
into the color picture data of the 2nd different color coordinate system from the 1st color 
coordinate system, and the inverse transformation matrix which performs inverse transformation 
of the conversion are prepared. Moreover, the augmented matrix from which the real number 
value x and -x are used as a component, and the sum of each line and the component of each 
train serves as abbreviation 0 is set up. And the transformation matrix for watermark embedding 
is created by adding an augmented matrix to a transformation matrix. Next, the watermark mark 
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embedded in a color picture is prepared, and the color picture data of the 1st color coordinate 
system is changed into the 2nd color coordinate system in the pixel equivalent to the location in 
a watermark mark using the transformation matrix for watermark embedding. The image data with 
a watermark showing the color picture with a watermark where the watermark mark was 
embedded is created by transforming inversely the color picture data of the 2nd color coordinate 
system acquired by this conversion to the 1st color coordinate system using an inverse 
transformation matrix. Moreover, it is spaced and attached by adjusting at least one of the real 
number value x and the arrays of each component in an augmented matrix in the case of a setup 
of an augmented matrix, and the visibility of the watermark mark in a color picture is adjusted. 
[0007] In this invention, by performing conversion and inverse transformation using a 
transformation matrix, and the inverse transformation matrix and augmented matrix between two 
color coordinate systems, it can space through a color picture and a mark can be embedded. If 
the value of the real number value x which specifies the component of an augmented matrix 
changes, the color of a watermark mark will change. Moreover, it spaces also by modification of 
the array of each component of an augmented matrix, and the color of a mark changes. 
Therefore, it is possible by adjusting at least one of the value of the real number value x of an 
augmented matrix, and the arrays of each component in an augmented matrix to adjust the 
visibility of a watermark mark. 

[0008] Here, the YCbCr color coordinate system which makes a parameter the RGB system of 
color representation, luminance signal, and color-difference signal which make the three primary 
colors of light a parameter as the 1st or 2nd color coordinate system is employable suitably. 
These color coordinate systems are what is often used when treating image data, and a mutual 
transformation matrix is known well. Therefore, much retouching software which deals with 
future image data exists, and digital watermarking can be embedded simple. 

[0009] In addition, the watermark mark may contain two or more mark groups separated spatially 
mutually. At this time, visibility can be adjusted in some [ at least ] mark groups of two or more 
mark groups by setting the real number value x as a different value from other mark groups. If it 
carries out like this, it is possible to embed two or more mark groups from which visibility differs 
in a color picture. 

[0010] Moreover, the watermark mark may be classified into the partition field of plurality 
[ field / mark ] with ** in the mark field which consists of pixels which continued spatially. At 
this time, visibility can be adjusted in some [ at least ] partition fields of two or more partition 
fields by setting the real number value x as a different value from other partition fields. If it 
carries out like this, it is possible to embed a watermark mark which includes the mark field 
which consisted of two or more partition fields in which visibility differs in a color picture. 
[001 1] Adjustment of visibility can be carried out by replacing the trains or lines of said 
augmented matrix. If it carries out like this, it is possible to only set a watermark mark as desired 
visibility by exchange of trains or lines. 

[0012] In addition, it is also possible to space, for it to be attached, to space in a color picture, 
and to reduce the visibility of a watermark mark when a mark can check by looking with the 
naked eye. Under the present circumstances, the product of an inverse transformation matrix 
and said augmented matrix, a transformation matrix and the unit matrix which has an equal 
degree, and the invisibility-ized matrix that is an inverse matrix of the sum of ** are prepared 
first. And in the pixel equivalent to the location in a watermark mark, the visibility of the 
watermark mark which can be checked by looking is reduced by being spaced and attached and 
making image data operate an invisibility-ized matrix. 

[0013] Furthermore, it is desirable to face [ transforming inversely to said RGB system of color 
representation using an inverse transformation matrix ] the image data of the YCbCr color 
coordinate system acquired by conversion by the transformation matrix for watermark 
embedding, and to perform underflow amendment and overflow amendment so that each pixel 
value in the image data of an RGB system of color representation may turn into an integral value 
of a predetermined range. If it carries out like this, the result of having transformed inversely can 
be dedicated within limits which the image data of an RGB system of color representation can 
take. 
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[0014] As for the real number value x of an augmented matrix, it is desirable to set it as the 
value of about 0.01 to about 0.7 range. If it carries out like this, since the incidence rate of 
underflow amendment or overflow amendment can be stopped small, deterioration of the 
substantial image quality by the embedding of a watermark mark can be reduced. 
[0015] In addition, this invention is realizable in various modes, such as a computer program for 
realizing the function of the digital-watermarking method and equipment, its method, or 
equipment, a record medium which recorded the computer program, and a data signal embodied 
in the subcarrier including the computer program. 
[0016] 

[Embodiment of the Invention] A. Embedding processing of digital watermarking, and the principle 
of decode processing : explain the gestalt of operation of this invention hereafter based on an 
example. Drawin g 1 is explanatory drawing of the principle of embedding processing of digital 
watermarking to the digital color picture in an example. Moreover, drawin g 2 is explanatory 
drawing showing the contents of embedding processing. 

[0017] Drawin g 2 (A) shows the digital color picture which is a subject-copy image expressed by 
the RGB system of color representation. This subject-copy image P is defined as the aggregate 
of the pixel of a large number arranged in the shape of a matrix, and the magnitude of the 
subject-copy image P is prescribed by horizontal resolution Hsize and vertical definition Vsize. In 
addition, the unit of horizontal resolution or vertical definition is the number of pixels. 
[0018] In this specification, the image data showing the color of each pixel of the subject-copy 
image P is defined by matrix =[ P] [r, g, b] t (the alphabetic character with a top "t" shows a 
transposed matrix), the red (r) r, g, and whose b are the three primary colors of light here — 
green — (g) and blue (b) — it is the brightness of each color component. The brightness of each 
color is expressed with predetermined resolution (for example, 256 gradation from zero to 255). 
Moreover, the YCbCr color coordinate system which specifies the color of each pixel and which 
consists of the luminance signal and two color-difference signals other than an RGB system of 
color representation if a color coordinate system is carried out is known widely. The image data 
which expresses the color of each pixel by the YCbCr color coordinate system in this 
specification is matrix =[ F] [y, cb, cr] t. It defines. 

[0019] These two color coordinate systems can be mutually changed reversibly by the 
chrominance-signal transformation matrix A and its inverse matrix A-1, as shown in the following 
(1a) and a formula (1b). 
[0020] 
[Equation 1] 

F(i,j)=AP(i,j) (la) 



0b) 



[0021] here, chrominance signals P and F are given — **** (i, j) — the location of a pixel is 
meant. 

[0022] In this example, what is given by the following (2a) and the (2b) formula as a 
transformation matrix A and an inverse transformation matrix A-1 is used. 
[0023] 



(2a) 



[Equation 2] 










0.299 


0.587 


0.114 


A~ 




0.169 


-0.331 


0.500 






0.500 


-0.419 


-0.081 






1.000 


-0.001 


1.402 


A~* 




1.000 


-0.344 


-0.714 






1.000 


1.772 


0.001 



(2b) 



[0024] In this example, it spaces, in case image data P of an RGB system of color representation 
is changed into image data F of a YCbCr color coordinate system, a mark is embedded, by 
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transforming this inversely to an RGB system of color representation again, it is spaced and 
attached and an image is created, the transformation matrix (it is called "the transformation 
matrix for embedding") used for the embedding of a watermark mark is a thing (namely, (A+X)) 
adding the augmented matrix X given to a transformation matrix A by the following (3) formulas 
[0025] 
[Equation 3] 

0 -x x 



x 0 -x 
-x x 0 

Cut, xiinmm-z&z. 



(3) 



[0026] This augmented matrix X is a matrix in which the real number value x and -x are used as 
a component, and the sum of each line and the component of each train is set to 0. In addition, 
in this specification, a "watermark value" also calls a call and an augmented matrix X a 
"watermark matrix" for this real number value x. It opts for the configuration of such a 
watermark matrix X for the following reasons. First, it considers embedding so that a watermark 
mark cannot be checked by looking with the naked eye. For this reason, it is desirable to prevent 
the image quality deterioration by the pad of a watermark as much as possible. By the way, when 
each component of the transformation matrix A given by the formula (2a) is observed, it turns 
out that all the sums of the absolute value of the component of each line are 1. Therefore, also 
in the transformation matrix (A+X) for embedding, it is desirable to hold relation in which the sum 
of the absolute value of the component of each line is set to 1, when preventing image quality 
deterioration. (3) Since the watermark matrix X of a formula is set up so that the sum of each 
line and the component of each train may be set to 0, such a demand has been satisfied. 
[0027] In case it spaces through the subject-copy image P and a mark is embedded, the mark 
image M which should be embedded and which spaces and includes a mark is prepared besides 
this subject-copy image P. An example of the mark image M used by this example is shown in 
drawin g_2 (B). This mark image M is a binary image, the pixel value m in the field of two 
alphabetic characters "I" which constitute a watermark mark, and "T" is 1 , and the pixel value m 
in other fields is 0. Below, the pixel value m only calls "the service area of a watermark mark", or 
a "mark field" and the field a call and whose pixel value m are 0 "the non-service area of a 
watermark mark" for the field which is 1. In addition, the service area of a watermark mark may 
only be called a "watermark mark." For example, the **** "the location in a watermark mark" 
has the same semantics as "the location in the service area of a watermark mark." 
[0028] The mark image M of this example has the same size as the subject-copy image P. 
However, the necessity of having the same size as the subject-copy image P does not have the 
mark image M, and the location of a watermark mark embedded in the subject-copy image M 
should just be determined by a certain method. 

[0029] In case a watermark mark is embedded, according to the following (4a) and a formula (4b), 
conversion to a YCbCr color coordinate system from an RGB system of color representation is 
performed first. 
[0030] 
[Equation 4] 

F x (iJ)-(A + X)P(iJ) (4a) 
F x {iJ) =AP(iJ) ;/w(i,;>0 (4A) 

[0031] that is, in the pixel (pixel of m(i, j) = 1) of the location equivalent to the service area of a 
watermark mark, it spaced with the original transformation matrix A, and Matrix X was added — 
embedding — business — conversion of a color coordinate system is performed using a 
transformation matrix (A+X). On the other hand, conversion of a color coordinate system is 
performed in the pixel (pixel of m(i, j) = 0) of the location equivalent to the non-service area of a 
watermark mark, using the original transformation matrix A as it is. 

[0032] watermark information was embedded when data processing by (4a) and the formula (4b) 



http:/ / www4.ipdl.jpo.gojp/cgi-bin/tran_web_cgi_eiie 



04/03/08 



5/10 ^— v 



was performed to all pixels — spacing — being attached — YCbCr image data FX It is obtained 
( drawin g 1 , drawing 2 (O). 

[0033] Next, this YCbCr image data FX with a watermark RGB-image-data PX with a watermark 
which will be given by the following (5a) and the formula (5b) if it receives and the inverse 
transformation matrix A-1 is made to operate it from the left It is obtained ( drawin g 1 ) 
[0034] 
[Equation 5] 

P x (iJ)=A-\A+X)P(i,j) 

=P(Uj) + A- } XP(iJ) ;jn(i v y)-l (5a) 
P x (i,j)=A-*AP(iJ) 

-P{U]) ;m(U)-0 (5b) 

[0035] It is spaced and attached as shown in this (5a) formula, and it is RGB-image-data PX. 
Original RGB-image-data P is overlapped on a noise component (A-1XP) in the service area of a 
watermark mark. Moreover, it is spaced and attached in the non-service area of a watermark 
mark, and is RGB-image-data PX. It has the value equal to original RGB-image-data P. 
[0036] By the way, the sum of the component of each line of the watermark matrix X is 0 as 
shown in the above-mentioned (3) formula. Therefore, when the value of r of original RGB- 
image-data P (i, j), g, and b component is mutually equal (at namely, the time of an achromatic 
color), the noise component (A-1XP) of a formula (5a) will be set to 0. In order to prevent such a 
problem, as for a watermark mark, it is desirable to position to the field which is not an 
achromatic color in a subject-copy image. 

[0037] In addition, drawin g 2 (C) shows the condition that it is spaced and attached and the 
watermark mark in an image looks [ **** ] thin. However, the visibility (the ease of carrying out 
of recognition by the naked eye) of a watermark mark can be adjusted by adjusting the 
watermark value x in the watermark matrix X in fact. About the method of adjustment of the 
visibility of a watermark mark, it mentions later further. 

[0038] By the way, usually YCbCr image data consists of real number values to RGB image data 
consisting of integral values. Therefore, in case it changes into a YCbCr color coordinate system 
by (4a) and the formula (4b), real number-ization is performed, and integer-ization is performed 
in case it transforms inversely to an RGB system of color representation by (5a) and the formula 
(5b). In the case of this integer-izing, the case where a pixel value serves as negative and an 
underflow is generated, and the case where it is overflowed exceeding the maximum of a pixel 
value occur. In order to solve this problem, in this example, underflow amendment and overflow 
amendment are performed in the case of integer-izing. That is, in performing underflow 
amendment set to 0 when the pixel value before integer-izing becomes negative, and exceeding 
the upper limit (for example, 255) of the bit expression, it performs overflow amendment which 
adopts the upper limit. 

[0039] If underflow amendment and overflow amendment are performed, it will be spaced and 
attached and the substantial image quality of an image will be degraded. Here, "substantial 
deterioration" means deterioration of the image quality which cannot be recovered even if it 
eliminates a watermark mark. Since it originates in having spaced underflow amendment and 
overflow amendment through the original transformation matrix A, and having added Matrix X, the 
incidence rate of underflow amendment or overflow amendment spaces, and is dependent on the 
watermark value x which is the component of Matrix X. Therefore, as for the watermark value x, 
it is desirable to set it as a value which underflow amendment and overflow amendment seldom 
generate. 

[0040] Drawin g_3 is explanatory drawing showing the relation between the watermark value x and 
the incidence rate of underflow amendment and overflow amendment, "girl" and "graphic" which 
are the standard image used for the characterization of image quality here The result related 
with two images is shown. In addition, it is thought that results differ by the case where it is the 
case where the watermark value x is 0.1, and -0.1 because a bias is in distribution of the 
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components r, g, and b of three colors in an image. The result of drawin g 3 shows that it is 
desirable to set the watermark value x as about 0.7 or less value, in order to stop low the 
incidence rate of underflow amendment and overflow amendment. In addition, since it cannot 
space if the watermark value x is set as 0, and a mark cannot be embedded, it is desirable to set 
the watermark value x as about 0.01 or more values in fact. Therefore, it is desirable to set it as 
the value of about 0.01 - about 0.7 range as a watermark value x. 

[0041] By the way, when [ which it spaces and a mark cannot recognize with the naked eye ] 
embedded, it will be necessary to restore the watermark mark. By being able to recognize with 
the naked eye, and twisting and spacing, a mark spaces, and it is attached, and is RGBHmage- 
data PX. By using the noise component (A-1XP) contained, decoding by the following various 
methods is possible. 

[0042] The 1st method is a method of performing color modification processing of an image so 
that it may be spaced and attached and the brightness value of each components r, g, and b of a 
RGB image may be raised to near the maximum. If it carries out like this, since a noise 
component (A-1XP) will also become large, it becomes easy to recognize a watermark mark with 
the naked eye. 

[0043] The 2nd method is spaced, is attached and is RGB-image-data PX. It is the method of 
using the noise component (A-1XP) contained directly. That is, it is spaced and attached, using 
the subject-copy image data P as a key, and is RGB-image-data PX. A watermark mark (namely, 
watermark information) can be decoded by determining the field which sets and has a noise 
component (A-1XP). It is spaced and attached and, specifically, is RGB-image-data PX. It is 
possible to ask for difference (PX-P) with original RGB-image-data P, and to determine the field 
this difference (PX-P) of whose is not 0 as a mark field. In addition, difference (PX-P) is a matrix 
which has three components, r, g, and b, and **** "difference (PX-P) is not 0" means that at 
least one of the three components is not 0. 

[0044] In addition, if the noise component (A-1XP) in a mark field is made to operate a 
transformation matrix A from the left, the product (XP) of the watermark matrix X and the 
subject-copy image data P will be obtained. If the subject-copy image data P is known, also 
when the watermark value x is unknown, it is possible to space from this product (XP) and to 
decode the watermark value x of Matrix X. 

[0045] As mentioned above, a watermark mark can be embedded in a color picture by [ which 
spaced through the transformation matrix A and added Matrix X ] embedding and using the 
transformation matrix (A+X) of business. Moreover, the thing which it spaced, and it was 
attached and was embedded from the image and which space and restores a mark is also 
possible. 

[0046] B. adjustment [ of the visibility of a watermark mark ]: — it mentioned above — as — 
spacing — being attached — RGB image PX **** — in the mark field, it is superimposed on the 
noise component (A-1XP). Therefore, it is possible by adjusting the magnitude of the watermark 
value x and changing the value of a noise component (A-1XP) to adjust the visibility of a 
watermark mark. 

[0047] Drawin g 4 is explanatory drawing showing the adjustment method of the visibility of a 
watermark mark. The subject-copy image P of drawin g 4 (A) and the mark image M of d rawin g 4 
(B) are the same as what was shown in drawin g 2 (A) and (B). 

[0048] If the watermark value x is set as about about 0.7 comparatively big value, as shown in 
drawing 4 (C), it is spaced and attached and the watermark mark in an image can recognize 
clearly with the naked eye. Such a watermark mark is called "a visible watermark" on these 
specifications. If it spaces through a field with little change of color and a mark exists especially, 
change of the color in a mark field can be recognized more clearly. Therefore, in order to make a 
watermark mark easy to check by looking, it is desirable to space through a field with little 
change of color, and to position a mark. 

[0049] When the watermark value x is set as about about 0.05 comparatively small value, it is 
spaced and attached and it becomes impossible on the other hand, for the watermark mark in an 
image to recognize with the naked eye, as shown in drawin g 4 (E). Such a watermark mark is 
called "an invisible watermark" on these specifications. In addition, although the dotted line 



http:/ / www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



04/03/08 



7/10 ^— v 



shows the appearance of a mark field in d rawin g 4 (E) in order to show the location of a 
watermark mark, it is possible to space through the degree which can hardly be recognized with 
the naked eye in fact, and to invisibility-ize a mark. Especially, lightness is in the orientation 
which cannot check a watermark mark by looking easily in a low field and the field of the 
chromatic color near an achromatic color. Therefore, in order to make a watermark mark hard to 
check by looking, it is desirable to space through the field where lightness is low, and the field of 
the chromatic color near an achromatic color, and to position a mark. 

[0050] If the watermark value x is set as the in-between value of a visible watermark and an 
invisible watermark, a translucent watermark (it is called "a half-visible watermark") is generable. 
For example, if the watermark value x is set as about about 0.3 value, as shown in drawing 4 (D), 
it will be spaced and attached and the watermark mark in an image will become translucent. 
[0051] Thus, it is possible by setting the watermark value x as a suitable value to set the 
visibility of a watermark mark as a desired degree. 

[0052] By the way, it is possible by adjusting the array of the watermark matrix X to adjust the 
color of a watermark mark instead of adjusting the watermark value x as mentioned above. 
Namely, watermark matrix [ 1 and 3 ] 1 and X 2X which spaces and is illustrated by the following 
(6) types and (7) types instead of Matrix X as shown in (3) types If embedding processing used 
and mentioned above is performed, the color of a watermark mark will be changed. 
[0053] 
[Equation 6] 
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[Equation 7] 








' X -JC 


0 






-x 0 


X 


(7) 




0 x 


-X 





[0055] (6) Watermark matrix 1 and X 2 of a formula The 1st line of the watermark matrix X of (3) 
types and the 2nd line are replaced. Moreover, watermark matrix 1 and X 3 of (7) types The 1st 
line of the watermark matrix X of (3) types and the 3rd line are replaced. Generally it is possible 
by replacing the trains or lines of the watermark matrix X to change the color of a watermark 
mark so that these examples may show. In addition, if the color of a watermark mark is changed, 
the ease (namely, visibility) of carrying out of recognition by the naked eye will also change in 
many cases. So, on these specifications, changing the color of a watermark mark also 
corresponds to "adjustment of visibility" by replacing the trains or lines of a watermark matrix in 
this way. 

[0056] C. Invisibility-ized processing of a visible watermark : a visible watermark can be 
invisibility-ized by processing of further the following. It is spaced and attached that a watermark 
mark can recognize with the naked eye so that he can understand from the formula (5a) 
mentioned above, and it is image data PX. It is because the noise component (A-1XP) is 
comparatively large. Therefore, it is possible to invisibility-ize a visible watermark by performing 
processing which reduces a noise component (A-1XP). In the case of this invisibility-ized 
processing, the invisibility-ized matrix K given by the following (8) formulas is used 
[0057] 
[Equation 8] 



K-(I+A~ A X) 



(8) 



[0058] Here, I is the unit matrix of 3x3. That is, the invisibility-ized matrix K is the unit matrix I 
and the inverse matrix of the sum (I+A-1X) of ** which space with the inverse transformation 
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matrix A-1, and have the product (A-1X) of Matrix X, and a degree equal to a transformation 
matrix A. 

[0059] About this invisibility-ized matrix K, as shown in drawing 5 , it is RGB-image-data PX with 
a watermark of a formula (5a). If it is operated, that addition result will be given by the following 
(9) formulas. 
[0060] 
[Equation 9] 

KP X (iW)-</ +A- } Xy l (/ X)P(iJ) 

*P(iJ) (9) 

[0061] Here, that the right-hand side of the 2nd line of (9) types is P' (i, j) means that it may not 
return to original image data P (i, j) completely according to the operation error in the middle of 
the embedding processing mentioned above (rounding error). That is, since integer-ization is 
performed when transforming inversely from a YCbCr signal to an RGB code, image data P' after 
invisibility-izing (i, j) may be unable to acquire the completely same value as the subject-copy 
image data P (i, j). However, since the error is a small amount below decimal point, with the 
naked eye, it is visible to the condition of not being different from a subject-copy image. [ of the 
image after invisibility-izing ] However, when the error by overflow amendment or underflow 
amendment is big, even if it performs invisibility-ization, it becomes impossible to return color to 
a dimension, and the trace of a watermark mark may be able to be checked by looking. 
Therefore, in order to be able to carry out [ invisibility ]-izing as completely as possible, it is 
desirable to use the small watermark value x of the degree which generates neither overflow 
amendment nor underflow amendment not much. 

[0062] In addition, since image data P' after invisibility-izing includes the error in the mark field, 
it can decode a watermark mark also from image data P' after invisibility-izing. For example, 
image data P' after invisibility-izing and difference (P' - P) with the subject-copy image data P 
can be taken, and this difference (P f - P) can determine in 0 the field which is not as a mark 
field. 

[0063] E. Improvement measure in security : one watermark value x was used for the whole 
watermark mark in above-mentioned explanation. When a third person gets to know the 
watermark value x temporarily, there is a possibility of a watermark of a false being created or 
changing a watermark mark easily. Then, in order to strengthen the security of digital 
watermarking, it is desirable to apply two or more watermark values x in a mark image. 
[0064] Drawin g 6 is explanatory drawing showing the example which applied two or more 
watermark values x in the mark image. A different watermark value x1 to the mark field of two 
alphabetic characters T' and T which constitutes a watermark mark from drawin g 6 (A), and 
x2 It is applied. Moreover, a watermark value x1 which 2 sets of mark groups spatially separated 
in the mark image are arranged in drawin g 6 (B), and is different to these two mark groups and x2 
It is applied. In addition, it is also possible to consider that an alphabetic character "f and "T" 
are a mutually different mark group also in the case of drawin g 6 (A). That is, it is possible to set 
up a mutually different watermark value x to two or more mark groups generally separated 
spatially mutually. Since the visibility of a watermark mark changes according to the watermark 
value x as mentioned above, it is possible for it to be spaced and attached and to embed the 
mark group of various visibility in an image by setting up a watermark value x which is different in 
two or more mark groups in a mark image. 

[0065] Drawin g 7 is explanatory drawing showing the example of a partition of the mark field for 
a multiplex watermark. In the example of drawing 7 , the mark field which consists of one 
alphabetic character "T" is classified into two or more partition fields, and a different watermark 
value x is applied to the adjoining partition field. Various methods, such as the method of 
classifying with parallel lines like dr awin g 7 (A) as the partition method of a mark field and the 
method of classifying with a multiplex contour line-like border line like shown in drawin g 7 (B), 
can be considered. In addition, "one mark field" means the service area which consists of pixels 



http://www4jpdl.jpo.gojp/cgi-bin/tran_web_cgLeije 



04/03/08 



9/10 s<— v 



which continued spatially. 

[0066] Since the watermark value x applied to each partition field can be kept secret by such 
multiplex watermark method, it is able for a third person to space and to prevent to discover a 
value x easily. 

[0067] F. Whole equipment configuration and procedure : draw ing 8 is the block diagram showing 
the configuration of the digital-watermarking processor which performs above-mentioned digital- 
watermarking processing by this example. This digital-watermarking processor is a computer 
equipped with CPU22, the main memory 24 containing ROM and RAM, a frame memory 26, a 
keyboard 30, a mouse 32, an indicating equipment 34, a hard disk 36, a modem 38, the scanner 
39 that reads an image, and the bus 40 which connects each of these elements. In addition, 
various kinds of interface circuitries are omitted in drawing 8 . The modem 38 is connected to 
the computer network through the communication line which is not illustrated. The server which 
a computer network does not illustrate has a function as a program feeder which supplies a 
computer program to a digital-watermarking processor through a communication line. 
[0068] The computer program for realizing the function of the digital-watermarking embedding 
section 42, the digital-watermarking decode section 44, the watermark visualization section 46, 
and ** is stored in main memory 24. It is as having spaced with the digital-watermarking 
embedding section 42 and the digital-watermarking decode section 44, and having already 
explained the function of the visualization section 46 in detail. 

[0069] The computer program which realizes the function of these each part 42, 44, and 46 is 
offered with the gestalt recorded on the record medium which a flexible disk, CD-ROM, etc. can 
computer read. A computer reads a computer program in the record medium, and transmits it to 
internal storage or external storage. Or you may make it supply a computer program to a 
computer through a communication path. When realizing the function of a computer program, the 
computer program stored in internal storage is executed by the microprocessor of a computer. 
Moreover, a computer reads the computer program recorded on the record medium, and it may 
be made to carry out immediate execution. 

[0070] In this specification, a computer is a concept containing hardware and operation system, 
and means the hardware which operates under control of operation system. Moreover, operation 
system is unnecessary, and when it seems that hardware is operated by the application program 
independent, the hardware itself is equivalent to a computer. Hardware is equipped with 
microprocessors, such as CPU, and the means for reading the computer program recorded on 
the record medium at least. The computer program contains in such a computer the program 
code which realizes the function of each above-mentioned means. In addition, a part of above- 
mentioned function may be realized by not an application program but operation system. 
Furthermore, the program which performs embedding processing of digital watermarking, decode 
processing, and invisibility-ized processing of a watermark is good also as what is added in the 
form of plug-in to the program which performs an image processing. 

[0071] In addition, as a "record medium" in this invention, computers, such as internal storage 
(memory, such as RAM and ROM) of the printed matter with which signs, such as a flexible disk, 
CD-ROM and a magneto-optic disk, an IC card, a ROM cartridge, a punch card, and a bar code, 
were printed, and a computer, and external storage, can use various data medium in which read 
is possible. 

[0072] D rawin gJ? is a flow chart which shows the procedure of the embedding processing which 
the embedding section 42 of digital watermarking performs. At step S1, the original RGB image P 
and the mark image M are prepared. At step S2, the transformation matrix A used for conversion 
of a color coordinate system and its inverse transformation matrix A-1 are prepared. At step S3, 
the watermark matrix X and the watermark value x are set up, respectively. In addition, a user is 
able to perform various setup which includes the adjustment of the visibility space and according 
to the value of a value x mentioned above, adjustment of the visibility by exchange of the lines of 
the watermark matrix X, or trains, and a setup of two or more watermark values x which can be 
set in a mark image at step S3. 

[0073] At step S3, embedding processing mentioned above is performed using the transformation 
matrix (A+X) for embedding, and the inverse transformation matrix A-1. It is spaced and 
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attached and an image is expressed on a display 34 as step S5. or it spaces, and it is attached 
and you may make it print an image by the printer which is not a drawing example At step S6, it 
spaces, it is attached and an image is observed, and if a user is this thing that can satisfy a 
result, he will end embedding processing. When it cannot be satisfied with a result, it spaces 
through step S3 with return and the watermark matrix X, a setup of a value x is changed, and 
step S4 and S5 are performed again. In this way, the thing for which the watermark mark of 
desired visibility was embedded and which spaces, are attached and creates an image is possible 
by repeating steps S3-S6. 

[0074] in addition, as for decode of the watermark mark by the watermark decode section 44 
( drawi ng 8 ), and invisibility-izing of the visible watermark by the watermark invisibility-ized 
section 46, the watermark mark was embedded — it spaces, and it is attached and performs to 
an image if needed. Explanation of such procedure is omitted. 

[0075] In addition, this invention can be carried out in various modes in the range which is not 
restricted to an above-mentioned example or an above-mentioned operation gestalt, and does 
not deviate from that summary, for example, the following deformation is also possible for it. 
[0076] (1) You may make it transpose a part of configuration of that hardware was realized to 
software, and may make it transpose a part of configuration of that reverse was realized by 
software to hardware in the above-mentioned example. For example, it is also possible to space 
with the digital-watermarking embedding section 42 and the digital-watermarking decode section 
44 which were realized by the computer program in drawin g 8 , and to realize the function of the 
visualization section 46 by the hardware circuitry of respectively dedication. 
[0077] (2) Although it spaced by transforming inversely once changing into a YCbCr color 
coordinate system from an RGB system of color representation and embedding of a mark was 
performed in the above-mentioned example, with this, embedding may be performed by 
transforming inversely conversely, once changing into an RGB system of color representation 
from a YCbCr color coordinate system. Moreover, it is possible to use two color coordinate 
systems of the arbitration which can perform reversibly not only these two color coordinate 
systems but conversion and inverse transformation as a color coordinate system which can be 
used. 

[0078] (3) In the above-mentioned example, although conversion and inverse transformation 
were performed also with the pixel in the non-service area of a watermark mark using the 
transformation matrix A and the inverse transformation matrix A-1, respectively at the time of 
the embedding of a watermark mark, since it will return to subject-copy image data if inverse 
transformation is performed about a non-service area, it may not be made not to perform such 
conversion or inverse transformation. In this case, by [ which space and compounds the image 
data in a mark field to the subject-copy image data P (namely, overwrite) ] having performed 
embedding processing mentioned above and having been obtained in this way about the service 
area of a watermark mark, it is spaced and attached and is image data PX. The whole can be 
obtained. What is necessary is just to perform inverse transformation using the conversion which 
used the transformation matrix (A+X) for embedding, and the inverse transformation matrix A-1 
on the occasion of the embedding of a watermark mark about the pixel which spaces at least and 
is equivalent to the location in the service area of a mark, if it puts in another way. 
[0079] (4) Although the above-mentioned example showed the example by which the watermark 
mark is constituted from a character string, as a watermark mark, it is possible to use the 
objects (natural drawing, an illustration, LOGO, etc.) of arbitration other than a character string. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



TECHNICAL FIELD 



[The technical field to which invention belongs] This invention relates to the digital-watermarking 
technology which spaces through a color picture and embeds a mark electronically. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



PRIOR ART 



[Description of the Prior Art] With development of computer networks, such as the Internet, 
informational digitization progresses and the information which many users need simply can be 
accessed now. It is becoming the environment which refuses the author and can reproduce data 
easily [ there is nothing and ] on the other hand about the digital content which copyright has 
generated in the digital information, and the problem of the literary piracy accompanying an illegal 
copy has attracted attention. Then, the digital-watermarking technology which embeds 
watermark information, such as copyright information, to the data of a color picture for the 
purpose of preventing the literary piracy about the color picture which is the main information on 
a digital content etc. attracts attention. 

[0003] About this conventional kind of digital watermarking, many technical proposals are made 
to the shade image. Since considering the brightness component (Y component) it can treat 
about a color picture as well as a shade image, the technique of embedding digital watermarking 
for the brightness component corresponding to a shade image has been used. 
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EFFECT OF THE INVENTION 



[The means for solving a technical problem, and its operation and effect] In this invention, the 
transformation matrix which changes the color picture data of the 1st color coordinate system 
into the color picture data of the 2nd different color coordinate system from the 1st color 
coordinate system, and the inverse transformation matrix which performs inverse transformation 
of the conversion are prepared. Moreover, the augmented matrix from which the real number 
value x and -x are used as a component, and the sum of each line and the component of each 
train serves as abbreviation 0 is set up. And the transformation matrix for watermark embedding 
is created by adding an augmented matrix to a transformation matrix. Next, the watermark mark 
embedded in a color picture is prepared, and the color picture data of the 1st color coordinate 
system is changed into the 2nd color coordinate system in the pixel equivalent to the location in 
a watermark mark using the transformation matrix for watermark embedding. The image data with 
a watermark showing the color picture with a watermark where the watermark mark was 
embedded is created by transforming inversely the color picture data of the 2nd color coordinate 
system acquired by this conversion to the 1st color coordinate system using an inverse 
transformation matrix. Moreover, it is spaced and attached by adjusting at least one of the real 
number value x and the arrays of each component in an augmented matrix in the case of a setup 
of an augmented matrix, and the visibility of the watermark mark in a color picture is adjusted. 
[0007] In this invention, by performing conversion and inverse transformation using a 
transformation matrix, and the inverse transformation matrix and augmented matrix between two 
color coordinate systems, it can space through a color picture and a mark can be embedded. If 
the value of the real number value x which specifies the component of an augmented matrix 
changes, the color of a watermark mark will change. Moreover, it spaces also by modification of 
the array of each component of an augmented matrix, and the color of a mark changes. 
Therefore, it is possible by adjusting at least one of the value of the real number value x of an 
augmented matrix, and the arrays of each component in an augmented matrix to adjust the 
visibility of a watermark mark. 

[0008] Here, the YCbCr color coordinate system which makes a parameter the RGB system of 
color representation, luminance signal, and color-difference signal which make the three primary 
colors of light a parameter as the 1 st or 2nd color coordinate system is employable suitably 
Th ese color coordinate systems are what is often used when treating image data, and a mutual 
transformation matrix is known well. Therefore, much retouching software which deals with 
future image data exists, and digital watermarking can be embedded simple. 

[0009] In addition, the watermark mark may contain two or more mark groups separated spatially 
mutually. At this time, visibility can be adjusted in some [ at least ] mark groups of two or more 
mark groups by setting the real number value x as a different value from other mark groups. If it 
carries out like this, it is possible to embed two or more mark groups from which visibility differs 
in a color picture. 

[0010] Moreover, the watermark mark may be classified into the partition field of plurality 
[ field / mark ] with ** in the mark field which consists of pixels which continued spatially. At 
this time, visibility can be adjusted in some [ at least ] partition fields of two or more partition 
fields by setting the real number value x as a different value from other partition fields. If it 
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carries out like this, it is possible to embed a watermark mark which includes the mark field 
which consisted of two or more partition fields in which visibility differs in a color picture. 
[001 1] Adjustment of visibility can be carried out by replacing the trains or lines of said 
augmented matrix. If it carries out like this, it is possible to only set a watermark mark as desired 
visibility by exchange of trains or lines. 

[0012] In addition, it is also possible to space, for it to be attached, to space in a color picture, 
and to reduce the visibility of a watermark mark when a mark can check by looking with the 
naked eye. Under the present circumstances, the product of an inverse transformation matrix 
and said augmented matrix, a transformation matrix and the unit matrix which has an equal 
degree, and the invisibility-ized matrix that is an inverse matrix of the sum of ** are prepared 
first. And in the pixel equivalent to the location in a watermark mark, the visibility of the 
watermark mark which can be checked by looking is reduced by being spaced and attached and 
making image data operate an invisibility-ized matrix. 

[0013] Furthermore, it is desirable to face [ transforming inversely to said RGB system of color 
representation using an inverse transformation matrix ] the image data of the YCbCr color 
coordinate system acquired by conversion by the transformation matrix for watermark 
embedding, and to perform underflow amendment and overflow amendment so that each pixel 
value in the image data of an RGB system of color representation may turn into an integral value 
of a predetermined range. If it carries out like this, the result of having transformed inversely can 
be dedicated within limits which the image data of an RGB system of color representation can 
take. 

[0014] As for the real number value x of an augmented matrix, it is desirable to set it as the 
value of about 0.01 to about 0.7 range. If it carries out like this, since the incidence rate of 
underflow amendment or overflow amendment can be stopped small, deterioration of the 
substantial image quality by the embedding of a watermark mark can be reduced. 
[0015] In addition, this invention is realizable in various modes, such as a computer program for 
realizing the function of the digital-watermarking method and equipment, its method, or 
equipment, a record medium which recorded the computer program, and a data signal embodied 
in the subcarrier including the computer program. 
[0016] 

[Embodiment of the Invention] A. Embedding processing of digital watermarking, and the principle 
of decode processing : explain the gestalt of operation of this invention hereafter based on an 
example. Drawin gJ, is explanatory drawing of the principle of embedding processing of digital 
watermarking to the digital color picture in an example. Moreover, drawin g 2 is explanatory 
drawing showing the contents of embedding processing. 

[0017] Drawin g^ (A) shows the digital color picture which is a subject-copy image expressed by 
the RGB system of color representation. This subject-copy image P is defined as the aggregate 
of the pixel of a large number arranged in the shape of a matrix, and the magnitude of the 
subject-copy image P is prescribed by horizontal resolution Hsize and vertical definition Vsize. In 
addition, the unit of horizontal resolution or vertical definition is the number of pixels. 
[0018] In this specification, the image data showing the color of each pixel of the subject-copy 
image P is defined by matrix =[ P] [r, g, b] t (the alphabetic character with a top "t" shows a 
transposed matrix), the red (r) r, g, and whose b are the three primary colors of light here — 
green (g) and blue (b) — it is the brightness of each color component. The brightness of each 
color is expressed with predetermined resolution (for example, 256 gradation from zero to 255). 
Moreover, the YCbCr color coordinate system which specifies the color of each pixel and which 
consists of the luminance signal and two color-difference signals other than an RGB system of 
color representation if a color coordinate system is carried out is known widely. The image data 
which expresses the color of each pixel by the YCbCr color coordinate system in this 
specification is matrix =[ F] [y, cb, cr] t. It defines. 

[0019] These two color coordinate systems can be mutually changed reversibly by the 
chrominance-signal transformation matrix A and its inverse matrix A-1, as shown in the following 
(1a) and a formula (1b). 
[0020] 
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[Equation 1] 
F(i,j)=AP(i,j) 



(la) 
Ob) 



[0021] here, chrominance signals P and F are given — **** (i, j) — the location of a pixel is 
meant. 

[0022] In this example, what is given by the following (2a) and the (2b) formula as a 
transformation matrix A and an inverse transformation matrix A-1 is used 
[0023] 



(2a) 



[Equation 2] 










0.299 


0.587 


0.114 


A = 




0.169 


-0.331 


0.500 






0.500 


-0.419 


-0.081 






1.000 


-0.001 


1.402 


A- 1 




1.000 


-0.344 


-0.714 






1.000 


1.772 


0.001 



(7b) 



[0024] In this example, it spaces, in case image data P of an RGB system of color representation 
is changed into image data F of a YCbCr color coordinate system, a mark is embedded, by 
transforming this inversely to an RGB system of color representation again, it is spaced and 
attached and an image is created, the transformation matrix (it is called "the transformation 
matrix for embedding") used for the embedding of a watermark mark is a thing (namely, (A+X)) 
adding the augmented matrix X given to a transformation matrix A by the following (3) formulas 
[0025] 
[Equation 3] 

0 -xx 



x 

-X 



0 -Jt 
x 0 



(3) 



[0026] This augmented matrix X is a matrix in which the real number value x and -x are used as 
a component, and the sum of each line and the component of each train is set to 0. In addition, 
m this specification, a "watermark value" also calls a call and an augmented matrix X a 
"watermark matrix" for this real number value x. It opts for the configuration of such a 
watermark matrix X for the following reasons. First, it considers embedding so that a watermark 
mark cannot be checked by looking with the naked eye. For this reason, it is desirable to prevent 
the image quality deterioration by the pad of a watermark as much as possible. By the way, when 
each component of the transformation matrix A given by the formula (2a) is observed, it turns 
out that all the sums of the absolute value of the component of each line are 1. Therefore, also 
in the transformation matrix (A+X) for embedding, it is desirable to hold relation in which the sum 
of the absolute value of the component of each line is set to 1 f when preventing image quality 
deterioration. (3) Since the watermark matrix X of a formula is set up so that the sum of each 
line and the component of each train may be set to 0, such a demand has been satisfied. 
[0027] In case it spaces through the subject-copy image P and a mark is embedded, the mark 
image M which should be embedded and which spaces and includes a mark is prepared besides 
this subject-copy image P. An example of the mark image M used by this example is shown in 
drawing^ (B). This mark image M is a binary image, the pixel value m in the field of two 
alphabetic characters "I" which constitute a watermark mark, and "T" is 1, and the pixel value m 
in other fields is 0. Below, the pixel value m only calls "the service area of a watermark mark", or 
a mark field" and the field a call and whose pixel value m are 0 "the non-service area of a 
watermark mark" for the field which is 1. In addition, the service area of a watermark mark may 
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only be called a "watermark mark/' For example, the **** "the location in a watermark mark" 
has the same semantics as "the location in the service area of a watermark mark." 
[0028] The mark image M of this example has the same size as the subject-copy image P. 
However, the necessity of having the same size as the subject-copy image P does not have the 
mark image M, and the location of a watermark mark embedded in the subject-copy image M 
should just be determined by a certain method. 

[0029] In case a watermark mark is embedded, according to the following (4a) and a formula (4b), 
conversion to a YCbCr color coordinate system from an RGB system of color representation is 
performed first. 
[0030] 
[Equation 4] 

Fx J) - <>1 + *)P(i, j) I /) - 1 (4a) 
F x (iJ) =AP(iJ) ;m(i,y)=0 (4b) 

[0031] that is, in the pixel (pixel of m(i, j) = 1) of the location equivalent to the sen/ice area of a 
watermark mark, it spaced with the original transformation matrix A, and Matrix X was added — 
embedding — business — conversion of a color coordinate system is performed using a 
transformation matrix (A+X). On the other hand, conversion of a color coordinate system is 
performed in the pixel (pixel of m(i, j) = 0) of the location equivalent to the non-service area of a 
watermark mark, using the original transformation matrix A as it is. 

[0032] watermark information was embedded when data processing by (4a) and the formula (4b) 
was performed to all pixels — spacing — being attached — YCbCr image data FX It is obtained 
( drawing 1 , drawin g 2 (C)). 

[0033] Next, this YCbCr image data FX with a watermark RGB-image-data PX with a watermark 
which will be given by the following (5a) and the formula (5b) if it receives and the inverse 
transformation matrix A-1 is made to operate it from the left It is obtained ( d rawin g 1 ) 
[0034] 
[Equation 5] 

P x (iJ)=A-\A+X)P(iJ) 

=P(iJ) + A- ] XP(iJ) ;m(ij)=\ (5a) 
P x (iJ)=A~'AP(iJ) 

-P(iJ) ;m(ij) = 0 (5b) 

[0035] It is spaced and attached as shown in this (5a) formula, and it is RGB-image-data PX. 
Original RGB-image-data P is overlapped on a noise component (A-1XP) in the service area of a 
watermark mark. Moreover, it is spaced and attached in the non-service area of a watermark 
mark, and is RGB-image-data PX. It has the value equal to original RGB-image-data P. 
[0036] By the way, the sum of the component of each line of the watermark matrix X is 0 as 
shown in the above-mentioned (3) formula. Therefore, when the value of r of original RGB- 
image-data P (i, j), g, and b component is mutually equal (at namely, the time of an achromatic 
color), the noise component (A-1XP) of a formula (5a) will be set to 0. In order to prevent such a 
problem, as for a watermark mark, it is desirable to position to the field which is not an 
achromatic color in a subject-copy image. 

[0037] In addition, drawin g 2 (C) shows the condition that it is spaced and attached and the 
watermark mark in an image looks [ **** ] thin. However, the visibility (the ease of carrying out 
of recognition by the naked eye) of a watermark mark can be adjusted by adjusting the 
watermark value x in the watermark matrix X in fact. About the method of adjustment of the 
visibility of a watermark mark, it mentions later further. 

[0038] By the way, usually YCbCr image data consists of real number values to RGB image data 
consisting of integral values. Therefore, in case it changes into a YCbCr color coordinate system 
by (4a) and the formula (4b), real number-ization is performed, and integer-ization is performed 
in case it transforms inversely to an RGB system of color representation by (5a) and the formula 
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(5b). In the case of this integer-izing, the case where a pixel value serves as negative and an 
underflow is generated, and the case where it is overflowed exceeding the maximum of a pixel 
value occur In order to solve this problem, in this example, underflow amendment and overflow 
amendment are performed in the case of integer-izing. That is, in performing underflow 
amendment set to 0 when the pixel value before integer-izing becomes negative, and exceeding 
the upper limit (for example, 255) of the bit expression, it performs overflow amendment which 
adopts the upper limit. 

[0039] If underflow amendment and overflow amendment are performed, it will be spaced and 
attached and the substantial image quality of an image will be degraded. Here, "substantial 
deterioration" means deterioration of the image quality which cannot be recovered even if it 
eliminates a watermark mark. Since it originates in having spaced underflow amendment and 
overflow amendment through the original transformation matrix A, and having added Matrix X, the 
incidence rate of underflow amendment or overflow amendment spaces, and is dependent on the 
watermark value x which is the component of Matrix X. Therefore, as for the watermark value x, 
it is desirable to set it as a value which underflow amendment and overflow amendment seldom 
generate. 

[0040] Drawin g 3 is explanatory drawing showing the relation between the watermark value x and 
the incidence rate of underflow amendment and overflow amendment, "girl" and "graphic" which 
are the standard image used for the characterization of image quality here The result related 
with two images is shown. In addition, it is thought that results differ by the case where it is the 
case where the watermark value x is 0.1, and -0.1 because a bias is in distribution of the 
components r, g, and b of three colors in an image. The result of d rawin g 3 shows that it is 
desirable to set the watermark value x as about 0.7 or less value, in order to stop low the 
incidence rate of underflow amendment and overflow amendment. In addition, since it cannot 
space if the watermark value x is set as 0, and a mark cannot be embedded, it is desirable to set 
the watermark value x as about 0.01 or more values in fact. Therefore, it is desirable to set it as 
the value of about 0.01 - about 0.7 range as a watermark value x. 

[0041] By the way, when [ which it spaces and a mark cannot recognize with the naked eye ] 
embedded, it will be necessary to restore the watermark mark. By being able to recognize with 
the naked eye, and twisting and spacing, a mark spaces, and it is attached, and is RGB-image- 
data PX. By using the noise component (A-1XP) contained, decoding by the following various 
methods is possible. 

[0042] The 1st method is a method of performing color modification processing of an image so 
that it may be spaced and attached and the brightness value of each components r, g, and b of a 
RGB image may be raised to near the maximum. If it carries out like this, since a noise 
component (A-1XP) will also become large, it becomes easy to recognize a watermark mark with 
the naked eye. 

[0043] The 2nd method is spaced, is attached and is RGB-image-data PX. It is the method of 
using the noise component (A-1XP) contained directly. That is, it is spaced and attached, using 
the subject-copy image data P as a key, and is RGB-image-data PX. A watermark mark (namely, 
watermark information) can be decoded by determining the field which sets and has a noise 
component (A-1XP). It is spaced and attached and, specifically, is RGB-image-data PX. It is 
possible to ask for difference (PX-P) with original RGB-image-data P, and to determine the field 
this difference (PX-P) of whose is not 0 as a mark field. In addition, difference (PX-P) is a matrix 
which has three components, r, g, and b, and **** "difference (PX-P) is not 0" means that at 
least one of the three components is not 0. 

[0044] In addition, if the noise component (A-1XP) in a mark field is made to operate a 
transformation matrix A from the left, the product (XP) of the watermark matrix X and the 
subject-copy image data P will be obtained. If the subject-copy image data P is known, also 
when the watermark value x is unknown, it is possible to space from this product (XP) and to 
decode the watermark value x of Matrix X. 

[0045] As mentioned above, a watermark mark can be embedded in a color picture by [ which 
spaced through the transformation matrix A and added Matrix X ] embedding and using the 
transformation matrix (A+X) of business. Moreover, the thing which it spaced, and it was 
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attached and was embedded from the image and which space and restores a mark is also 
possible. 

[0046] B. adjustment [ of the visibility of a watermark mark ]: — it mentioned above — as — 
spacing — being attached — RGB image PX **** — in the mark field, it is superimposed on the 
noise component (A-1XP). Therefore, it is possible by adjusting the magnitude of the watermark 
value x and changing the value of a noise component (A-1XP) to adjust the visibility of a 
watermark mark. 

[0047] Drawin g 4 is explanatory drawing showing the adjustment method of the visibility of a 
watermark mark The subject-copy image P of drawin g 4 (A) and the mark image M of drawin g 4 
(B) are the same as what was shown in drawin g 2 (A) and (B). 

[0048] If the watermark value x is set as about about 0.7 comparatively big value, as shown in 
drawin g 4 (C), it is spaced and attached and the watermark mark in an image can recognize 
clearly with the naked eye. Such a watermark mark is called "a visible watermark" on these 
specifications. If it spaces through a field with little change of color and a mark exists especially, 
change of the color in a mark field can be recognized more clearly. Therefore, in order to make a 
watermark mark easy to check by looking, it is desirable to space through a field with little 
change of color, and to position a mark. 

[0049] When the watermark value x is set as about about 0.05 comparatively small value, it is 
spaced and attached and it becomes impossible on the other hand, for the watermark mark in an 
image to recognize with the naked eye, as shown in drawing 4 (E). Such a watermark mark is 
called "an invisible watermark" on these specifications. In addition, although the dotted line 
shows the appearance of a mark field in drawing 4 (E) in order to show the location of a 
watermark mark, it is possible to space through the degree which can hardly be recognized with 
the naked eye in fact, and to invisibility-ize a mark. Especially, lightness is in the orientation 
which cannot check a watermark mark by looking easily in a low field and the field of the 
chromatic color near an achromatic color. Therefore, in order to make a watermark mark hard to 
check by looking, it is desirable to space through the field where lightness is low, and the field of 
the chromatic color near an achromatic color, and to position a mark. 

[0050] If the watermark value x is set as the in-between value of a visible watermark and an 
invisible watermark, a translucent watermark (it is called "a half-visible watermark") is generable. 
For example, if the watermark value x is set as about about 0.3 value, as shown in draw ing 4 (D), 
it will be spaced and attached and the watermark mark in an image will become translucent. 
[0051] Thus, it is possible by setting the watermark value x as a suitable value to set the 
visibility of a watermark mark as a desired degree. 

[0052] By the way, it is possible by adjusting the array of the watermark matrix X to adjust the 
color of a watermark mark instead of adjusting the watermark value x as mentioned above. 
Namely, watermark matrix [ 1 and 3 ] 1 and X 2X which spaces and is illustrated by the following 
(6) types and (7) types instead of Matrix X as shown in (3) types If embedding processing used 
and mentioned above is performed, the color of a watermark mark will be changed 
[0053] 
[Equation 6] 





' x 0 


- X 






0 -x 


X 


(6) 




-X X 
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[0054] 








[Equation 7] 
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[0055] (6) Watermark matrix 1 and X 2 of a formula The 1st line of the watermark matrix X of (3) 
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types and the 2nd line are replaced. Moreover, watermark matrix 1 and X 3 of (7) types The 1 st 
line of the watermark matrix X of (3) types and the 3rd line are replaced. Generally it is possible 
by replacing the trains or lines of the watermark matrix X to change the color of a watermark 
mark so that these examples may show. In addition, if the color of a watermark mark is changed, 
the ease (namely, visibility) of carrying out of recognition by the naked eye will also change in 
many cases. So, on these specifications, changing the color of a watermark mark also 
corresponds to "adjustment of visibility" by replacing the trains or lines of a watermark matrix in 
this way. 

[0056] C. Invisibility-ized processing of a visible watermark : a visible watermark can be 
invisibility-ized by processing of further the following. It is spaced and attached that a watermark 
mark can recognize with the naked eye so that he can understand from the formula (5a) 
mentioned above, and it is image data PX. It is because the noise component (A-1XP) is 
comparatively large. Therefore, it is possible to invisibility-ize a visible watermark by performing 
processing which reduces a noise component (A-1XP). In the case of this invisibility-ized 
processing, the invisibility-ized matrix K given by the following (8) formulas is used. 
[0057] 
[Equation 8] 

K = (I+A^ Xy* (8) 

[0058] Here, I is the unit matrix of 3x3. That is, the invisibility-ized matrix K is the unit matrix I 
and the inverse matrix of the sum (I+A-1X) of ** which space with the inverse transformation 
matrix A-1, and have the product (A-1X) of Matrix X, and a degree equal to a transformation 
matrix A. 

[0059] About this invisibility-ized matrix K, as shown in drawin g 5 , it is RGB— image— data PX with 
a watermark of a formula (5a). If it is operated, that addition result will be given by the following 
(9) formulas. 
[0060] 
[Equation 9] 

KP X (ij)=(f -M- 1 Xy l (I +A~ X X)P(iJ) 

*P(iJ) (9) 

[0061] Here, that the right-hand side of the 2nd line of (9) types is P' (i, j) means that it may not 
return to original image data P (i, j) completely according to the operation error in the middle of 
the embedding processing mentioned above (rounding error). That is, since integer-ization is 
performed when transforming inversely from a YCbCr signal to an RGB code, image data P' after 
invisibility-izing (i, j) may be unable to acquire the completely same value as the subject-copy 
image data P (i, j). However, since the error is a small amount below decimal point, with the 
naked eye, it is visible to the condition of not being different from a subject-copy image. [ of the 
image after invisibility-izing ] However, when the error by overflow amendment or underflow 
amendment is big, even if it performs invisibility-ization, it becomes impossible to return color to 
a dimension, and the trace of a watermark mark may be able to be checked by looking. 
Therefore, in order to be able to carry out [ invisibility ]-izing as completely as possible, it is 
desirable to use the small watermark value x of the degree which generates neither overflow 
amendment nor underflow amendment not much. 

[0062] In addition, since image data P' after invisibility-izing includes the error in the mark field, 
it can decode a watermark mark also from image data P' after invisibility-izing. For example, 
image data P' after invisibility-izing and difference (P' - P) with the subject-copy image data P 
can be taken, and this difference (P' - P) can determine in 0 the field which is not as a mark 
field. 

[0063] E. Improvement measure in security : one watermark value x was used for the whole 
watermark mark in above-mentioned explanation. When a third person gets to know the 
watermark value x temporarily, there is a possibility of a watermark of a false being created or 
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changing a watermark mark easily. Then, in order to strengthen the security of digital 
watermarking, it is desirable to apply two or more watermark values x in a mark image. 
[0064] Drawin g 6 is explanatory drawing showing the example which applied two or more 
watermark values x in the mark image. A different watermark value x1 to the mark field of two 
alphabetic characters "I" and "T" which constitutes a watermark mark from drawin g 6 (A), and 
x2 It is applied. Moreover, a watermark value x1 which 2 sets of mark groups spatially separated 
in the mark image are arranged in dr awin g 6 (B), and is different to these two mark groups and x2 
It is applied. In addition, it is also possible to consider that an alphabetic character "I" and "T" 
are a mutually different mark group also in the case of drawin g 6 (A). That is, it is possible to set 
up a mutually different watermark value x to two or more mark groups generally separated 
spatially mutually. Since the visibility of a watermark mark changes according to the watermark 
value x as mentioned above, it is possible for it to be spaced and attached and to embed the 
mark group of various visibility in an image by setting up a watermark value x which is different in 
two or more mark groups in a mark image. 

[0065] Drawin g 7 is explanatory drawing showing the example of a partition of the mark field for 
a multiplex watermark. In the example of drawin g 7 , the mark field which consists of one 
alphabetic character T is classified into two or more partition fields, and a different watermark 
value x is applied to the adjoining partition field. Various methods, such as the method of 
classifying with parallel lines like drawin g 7 (A) as the partition method of a mark field and the 
method of classifying with a multiplex contour line-like border line like shown in drawing 7 (B), 
can be considered. In addition, "one mark field" means the service area which consists of pixels 
which continued spatially. 

[0066] Since the watermark value x applied to each partition field can be kept secret by such 
multiplex watermark method, it is able for a third person to space and to prevent to discover a 
value x easily. 

[0067] F. Whole equipment configuration and procedure : fravAng 8 is the block diagram showing 
the configuration of the digital-watermarking processor which performs above-mentioned digital- 
watermarking processing by this example. This digital-watermarking processor is a computer 
equipped with CPU22, the main memory 24 containing ROM and RAM, a frame memory 26, a 
keyboard 30, a mouse 32, an indicating equipment 34, a hard disk 36, a modem 38, the scanner 
39 that reads an image, and the bus 40 which connects each of these elements. In addition, 
various kinds of interface circuitries are omitted in drawing 8 . The modem 38 is connected to 
the computer network through the communication line which is not illustrated. The server which 
a computer network does not illustrate has a function as a program feeder which supplies a 
computer program to a digital-watermarking processor through a communication line. 
[0068] The computer program for realizing the function of the digital-watermarking embedding 
section 42, the digital-watermarking decode section 44, the watermark visualization section 46, 
and ** is stored in main memory 24. It is as having spaced with the digital-watermarking 
embedding section 42 and the digital-watermarking decode section 44, and having already 
explained the function of the visualization section 46 in detail. 

[0069] The computer program which realizes the function of these each part 42, 44, and 46 is 
offered with the gestalt recorded on the record medium which a flexible disk, CD-ROM, etc. can 
computer read. A computer reads a computer program in the record medium, and transmits it to 
internal storage or external storage. Or you may make it supply a computer program to a 
computer through a communication path. When realizing the function of a computer program, the 
computer program stored in internal storage is executed by the microprocessor of a computer. 
Moreover, a computer reads the computer program recorded on the record medium, and it may 
be made to carry out immediate execution. 

[0070] In this specification, a computer is a concept containing hardware and operation system, 
and means the hardware which operates under control of operation system. Moreover, operation 
system is unnecessary, and when it seems that hardware is operated by the application program 
independent, the hardware itself is equivalent to a computer. Hardware is equipped with 
microprocessors, such as CPU, and the means for reading the computer program recorded on 
the record medium at least. The computer program contains in such a computer the program 
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code which realizes the function of each above-mentioned means. In addition, a part of above- 
mentioned function may be realized by not an application program but operation system. 
Furthermore, the program which performs embedding processing of digital watermarking, decode 
processing, and invisibility-ized processing of a watermark is good also as what is added in the 
form of plug-in to the program which performs an image processing. 

[0071] In addition, as a "record medium" in this invention, computers, such as internal storage 
(memory, such as RAM and ROM) of the printed matter with which signs, such as a flexible disk, 
CD-ROM and a magneto-optic disk, an IC card, a ROM cartridge, a punch card, and a bar code, 
were printed, and a computer, and external storage, can use various data medium in which read 
is possible. 

[0072] Drawin g 9 is a flow chart which shows the procedure of the embedding processing which 
the embedding section 42 of digital watermarking performs. At step SI, the original RGB image P 
and the mark image M are prepared. At step S2, the transformation matrix A used for conversion 
of a color coordinate system and its inverse transformation matrix A-1 are prepared. At step S3, 
the watermark matrix X and the watermark value x are set up, respectively. In addition, a user is 
able to perform various setup which includes the adjustment of the visibility space and according 
to the value of a value x mentioned above, adjustment of the visibility by exchange of the lines of 
the watermark matrix X, or trains, and a setup of two or more watermark values x which can be 
set in a mark image at step S3. 

[0073] At step S3, embedding processing mentioned above is performed using the transformation 
matrix (A+X) for embedding, and the inverse transformation matrix A-1. It is spaced and 
attached and an image is expressed on a display 34 as step S5. or it spaces, and it is attached 
and you may make it print an image by the printer which is not a drawing example At step S6, it 
spaces, it is attached and an image is observed, and if a user is this thing that can satisfy a 
result, he will end embedding processing. When it cannot be satisfied with a result, it spaces 
through step S3 with return and the watermark matrix X, a setup of a value x is changed, and 
step S4 and S5 are performed again. In this way, the thing for which the watermark mark of 
desired visibility was embedded and which spaces, are attached and creates an image is possible 
by repeating steps S3-S6. 

[0074] in addition, as for decode of the watermark mark by the watermark decode section 44 
( dr awin g 8 ), and invisibility-izing of the visible watermark by the watermark invisibility-ized 
section 46, the watermark mark was embedded — it spaces, and it is attached and performs to 
an image if needed. Explanation of such procedure is omitted. 

[0075] In addition, this invention can be carried out in various modes in the range which is not 
restricted to an above-mentioned example or an above-mentioned operation gestalt, and does 
not deviate from that summary, for example, the following deformation is also possible for it. 
[0076] (1) You may make it transpose a part of configuration of that hardware was realized to 
software, and may make it transpose a part of configuration of that reverse was realized by 
software to hardware in the above-mentioned example. For example, it is also possible to space 
with the digital-watermarking embedding section 42 and the digital-watermarking decode section 
44 which were realized by the computer program in drawin g 8 , and to realize the function of the 
visualization section 46 by the hardware circuitry of respectively dedication. 
[0077] (2) Although it spaced by transforming inversely once changing into a YCbCr color 
coordinate system from an RGB system of color representation and embedding of a mark was 
performed in the above-mentioned example, with this, embedding may be performed by 
transforming inversely conversely, once changing into an RGB system of color representation 
from a YCbCr color coordinate system. Moreover, it is possible to use two color coordinate 
systems of the arbitration which can perform reversibly not only these two color coordinate 
systems but conversion and inverse transformation as a color coordinate system which can be 
used. 

[0078] (3) In the above-mentioned example, although conversion and inverse transformation 
were performed also with the pixel in the non-service area of a watermark mark using the 
transformation matrix A and the inverse transformation matrix A-1, respectively at the time of 
the embedding of a watermark mark, since it will return to subject-copy image data if inverse 
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transformation is performed about a non-service area, it may not be made not to perform such 
conversion or inverse transformation. In this case, by [ which space and compounds the image 
data in a mark field to the subject-copy image data P (namely, overwrite) ] having performed 
embedding processing mentioned above and having been obtained in this way about the service 
area of a watermark mark, it is spaced and attached and is image data PX. The whole can be 
obtained. What is necessary is just to perform inverse transformation using the conversion which 
used the transformation matrix (A+X) for embedding, and the inverse transformation matrix A-1 
on the occasion of the embedding of a watermark mark about the pixel which spaces at least and 
is equivalent to the location in the service area of a mark, if it puts in another way. 
[0079] (4) Although the above-mentioned example showed the example by which the watermark 
mark is constituted from a character string, as a watermark mark, it is possible to use the 
objects (natural drawing, an illustration, LOGO, etc.) of arbitration other than a character string. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] However, most proposals which are going to use the 
signal and data of a proper for a color picture, and are going to embed digital watermarking are 
not made, "depths information record of a color picture" (the **** society — ) which used the 
color space of a color printer as digital-watermarking embedding technology The collection of 
annual meeting drafts, 7 and 20, pp.47-48, "a way method of the color watermark in 
consideration of a vision property" (IMPS 97, 1-3.14, pp.45-46 (1997)) of model style molding 
which used the vision property skillfully, "A way method of the digital-watermarking embedding 
to a digital image" (SITA 97, Vol.2, pp.541 -544 (1997)) is proposed. Such technology has a 
complicated model and has the weak spot where pad processing of a watermark is not easy. 
Moreover, degrading the image quality of a color picture was also pointed out by the method of 
embedding a watermark at the lower bit of a color picture. 

[0005] This invention aims at offering the digital-watermarking technology for spacing through a 
color picture using the property of a proper, and embedding a mark. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[ Drawin g,!], Explanatory drawing showing the principle of embedding processing of digital 
watermarking which is one example of this invention. 

[ Drawin g 2] Explanatory drawing showing the contents of embedding processing of digital 
watermarking. 

[ Drawin g 3] Explanatory drawing showing relation with the incidence rate of the watermark value 
x, underflow amendment, and overflow amendment. 

[ Drawin g^] Explanatory drawing showing the adjustment method of the visibility of watermark 
information. 

[D rawin gjj] Explanatory drawing showing the principle of invisibility-ized processing of a visible 
watermark. 

[ Drawin gjj] Explanatory drawing showing the example which applied two or more watermark 
values x in the mark image. 

[ Draw ing 7] Explanatory drawing showing the example of a partition of the mark field for a 
multiplex watermark. 

[ Drawin g 8] The block diagram showing the outline configuration of the digital-watermarking 
processor which performs digital-watermarking processing in an example. 

[ Drawin g 9] The flow chart which shows the procedure of embedding processing of a watermark. 
[Description of Notations] 
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— CPU 
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— Frame memory 
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— Hard disk 
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— Modem 
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— Scanner 
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— Bus 
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— Digital-watermarking embedding section 
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— Digital-watermarking decode section 
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— Watermark invisibility-ized section 
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msit:m&^?> z k tf-5jmxfo& . 

[ 0 0 4 7 ] 134 14, a*»L-?-^c0"T««<!0iBt(5rj£ 
^-TI^ B JI1T'S>4„ H4 (A) c7)JMB*P*54t>'ia4 

(B) <DV-?BHM(4. H2 ( A) , (B) IZmLtz 
i><r>tm&X'h&. 

[0048] j§36»L«x*»0. 7gj£cOJt!KW*£ : 5: 
tttclS^-r^k, 04 (C) ^-Ti^tc;. »ft»Lft§ 

^jW4-»# o kraiS'caare&s. 
Lj twjz. mz, &M(r>&{tW'j?%^mmzmfrLv 
£>oitiZK)kmmxz?>. ^t, m&L-?-7zm 

[0049] S*>t«x ^1^0. 05SJKOit^ 

tfij'l^%mi,zmM-?&t. 04 (E) (c^-T4dC a 
B^rtiO^^ *^aBTl4l2^T'^ 
Z<?>£o%:Mlrl,-?-7i:, ^WfflWX'li r^rgj 
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WMfrLi fcPWs. 14 (E) TkL SA>Lv- 

wm&i&i^m®*?. mm^zj&^^(om.mx' 

ti, MfrL~?-7 ZmZLm^MftlzhZ, . tot. S 

[oo 50] jg^tiix^. ^rffla*»tkTHrsa*»t 

frLmxZmO. 3WS.com\,zW^.-thb. 04 (D) 

[0051] zcoxoiz^ MfrLmxzmwjmizmm 

[0 0 5 2] kZ*>X\ IMcoXolzMfrLmxZmm 
-T3r;b . ( 3 ) LfrJfl X coitt> 0 (C » 

<jw ( 6 ) msXTS < 7 ) jSifcWissjh.* x o%m*L 

ff?ijX lj2 , X 1>3 *fflvvCJa*Lfc**>S*«8I£fT 

[0 0 53] 
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^1,3 = 


-X 
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[0055] (6) ammfrLfrnxut <3)5S 
x'bh.ztz. mawaafrUfMx,,, (3) 

Ur*9 X<o$fiJ|3|±£ Jt«tf |S|±£ Aix§ 6 £ t C i o 
[ 0 0 5 6 ] c . ^r^*-t<7)^r^-ft^s : «rsa*» 



W.Z. &.Tcr>^m\,zX->X^mtthc\tiM 

mx-&&. uraufc ( 5 a > *&»&aarc# a ± 3 

t-?Pi <T)J4Xfc>rt (A-'XP) #ttlRtt*StV&> 
4>"C*4. fiHT. .MXjfcfr (A-'XP) ^ffiM-TS 

( 8 ) iZX'H-z. &*i*;F»HHfc?T*JK Srffl^S . 

[0057] 

[&8] 

^C^^ -1 *) -1 (8) 

[0058] ZZX\ U43x3<0#tSff?iJtr**. f 
fif^lJXcOS (A-'X) fc s Sa*Wf5>JA4;ajEtV^»dR*W 

-rs^efi^j i f: , o«i ( i +a-> x) comimx'fo 

[0059] ^co^rmff^JK Sr. H5^-rj: ? 
13, (5a) *«0»j&»LftS RG BUf-^P, Ctft 

[0060] 
[1*9] 

* p x c. ;)-(/ ^r* (/ +^ _1 j) 

-W) (9) 
[006 1 ]^;-C\ (9) ^c02^Ta<7)*3a^'P' 

»«ftc*s»ts«»ais (Aamu) tci^T. ^tca 

TCtfOB^T-'-^P ( i . j ) WiM^^V^fcA**-!)^ 
tZMSkLX^h* YCbC rfi-^*^RG 

mm<^m^-^p' a. j) * s ntf-^p 

(i, j) k-£<mim&&hZkltX'Z%:^ZbW$) 
L#>U ^commit. /JMBoSJaT^hS**^ 

yn-WJEdzit^i^iz^t^lz^ T^mtZft 
->xi>&$Z&7ci,zi> m*L-?-7(DBffi 

l (i x ^ m wc t> < ; t *w * t ^ . 

[0062] Sri*, ^mmc)W&7-f P ' (i. v 
Iff-^PJ:^(P' -P) ZkK). zcomt 

( p • - p ) tfox-am^im* . v-^®«t jfeg^- 
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[0063] E . -te* * U-f 4 fa±® : iiilgWl&HjJT- 

tzV-t&iiZixirhh. %ZX\ m^ii^LcOb^ a U 
x £3fiffl-r i L v ^ 

Sr^ffl Ltim^-tmmmx'h^ . 06 (a> -et*. m 

frL^-7*m$L-fh2^<7>X*? r I J . r Tj <75V- 
?®«C*fl.T, *SrS»6»Ufixi , x 2 WMmZtl 

x\^h. $.tz. me (b) rti, £0 
mz-bmzixti 2&cr>-?-?mm : B:ztix a o , zti 

jWSJ8$*VCV*&. &*J. 06 (A) <73*£fcfc. 33= 
r I j i: <"Tj 5>Hcfl&&-7-?Sre&.g>i:#;L 

*»b«x&Rje^-4ii:36nTirc*6. ±j*L?tJ:d 

mfrL^-7coBmmizm*LWxizfctx$£*>& 

cr>X\ -?-7mmft<?>1g.$!l<7>'?-7mt,zm%:&MfrLm 

[OO65J07I1 ^KS*»LOfctf>tf>^--?«irtZ> 

r Tj T«Jft$*lSv-^«ifc5(«, «»*>|&MRttK:lH: 
fl-Srt.Tfc'J. Bil^4B#««fcttl*$r*»*»Lfix 

jwamsivtv^. -?-?mm<?>&ttJjmtLxti. m 
7 (a) <o±3icw&TK#-ts:*rses\ 17 (b) 

^mjsj tn. ■smm^zmmLtzmmx-m^ix^^m 
mmzm&Lx^&. 

[0066];^ o^mm^^mx'\±, 
mzmmztix^&mfrLmxzwex'Z &<ox\ m= 

^mx-hh. 

[0067] f . imv&ftffifRbnam^m msa. 

3a*»L«raS»i« CPU22t. ROMfcit^RAM 

-*'-K30t. -7-7X3 2 i:. ^SB3 4t, ^~ 
KtmX?3 6£. ^-rA3 8t. B»£M^&-g>x* 
^3 9£. .1 ft &<0«SR 4 0 k , £ 

{f^S3>'t J .-^T'$)'&» 08-C'{±«-«O^ y 
?-7x-"fX|s]g&{£*B&$ftTl^,, tfA3 8lt 0 



^•9— aftigiiSr^LTnyeA-^Tn^^A 

[0 068] 5of*U 2 4t=ii, VmifiLWtojh 

^gP4 2 1 , m^mfr 4 1 . l 

4 6fc. «0^S:^-r-S^Onvb°i-^ra^7 
Ajfi«l6ttSftTV*S. m : ?Tg^Las , >jA^4 2i:«^ 

sta»ui#»4 4 tmi*v*tmcM4 ecommiz^x 
nmzm l < mm l Jt a o t* * . 

[ 0 0 6 9 ] dil^co#gB4 2 , 44, 4 6tfO«tg^H 

o x rtsuiEi^Mt fc^haJiE«^«Ktei*-r s . s> § 

v^i. jifI^IS2:^-tTrJ>'b J L-^^3yb' J .-^r 
[0 07 0] £<7)BBiffl«fcf3Vvt. 

/n— h 7i mat 5r^.i^-^ 3 y^t^ t *-str« 
^T-s> <5 , ^i^-^ a v^^^mm^Tx-mm- 

3 y^xr-^^mx'TT'j 7"— >- a yro^7 Am3i 
K7i7gflt CPUfW7>f;D7Dt7t!:, IB 

«aaE#KiE«s*ut ^ ^ e rn^5 a 

fcA<?5#ai:£2J«a:<fck»;iTVv&. 3Vb A -^7" 

<nmm*mmz*th7°vy7j±zi-YZ-%A,X'^z>. & 

T-^r<. j-'Os—i's y^f-Mzx->xmm^tix^ 
xi>&\,\ aye, m^^L<^a*63i^a^fi-^5ii 

wmzttoyvyyMzttvx. 7°?yj ycojmx- 

[ 0 0 7 1 ] ££L doaWHfcfcWS rfg^^j fc l, 
Tti. 71/^v'7'^7 i -f Xi7^CD-ROM. tKJI^.x 

[0072] i9ii, m7^^L-«a»a ! ^4 2*^ 

0Mfr&frW£ttM£fF:-tyx3-J- J r-hX'h&. X 
7-yrSlTii, ISRGBliPt, v-^M^MtSr 
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mm a i: „ zcow&tmm a- 1 1 . *x 
jg£ i-if j&sfr ozt awe* h . 

(A + X) taSEJIIffTSlA-ifcfcffltvc, -B*Ufc«rt> 
&»«3**ff$- & «. x-r y 7 S 5 TJi . m>* Ltt z m 

tt%mm&m^L*^7v yf-cmttt xdiztxh 
sos^&T-rs. ^mzm&x^^t at -/7 

S3 KM 9. j^Uf*|Xi:iaa»UIx*>f&5£*£3eL 

T--yrS3~S6$r^Djg-r^i:{-J:-5T. ffiSkftzpSL 
BL<rMtf> L~?—7 & tv&Sfr U+S H«£ fttfc 

COO 74] fcfc. 3ft6»La-^»4 4 (08) fciSii 

[0075]^, ^cof60H(±j 1 fecr)HJfe0iK>^Jf6^ 

[00 7 6] ( 1 ) JJESOtflfWcfclvC. a-H^!7 
£ J: o T$$K§*rC v^««<0-»S: V 7 h <7 x r 

T SSSSirC v vfc«j£*>-S£y \- H x T(cS£ Mi. 

?yu y^J^X'^M^tiX \ ^tzM^^ Lffi^ Agp 4 
2 4: m^ftg#> L«#SS4 4 i: L^-fk3P4 6 cDflltE 

*• . f^mfflwA- h x T®8&x'mm-& zti> 
*smx'h&. 

[0077] ( 2 ) jbJ2S8nerc«, r g bim*^ 

YC b C r ^fe^tC-S.^ IfcttiaBEttti - t IZ 
YCbC r^MA^RGBSMt-I^i 

utatassiw-* i t tz i otitoa^&ff^t t & 

^. 4fc, fiiffiT'£&^^£LT«:^it^2o<D^ 
[0078] ( 3 ) ±i2SU60tC«. mfrL-?-7<7)W. 



z o Lxnt>tiKmfrL-?-?imfHcDmm7 t - 

xa, >y%<khmfrL^-7<Dmhmmft<n®m.izi& 
%-ttmmiz^x. M#&*m$®&Tm (a+x) * 

ffl^fcSSftfc. jt^tT^JA-'iSrfflv^it^mh^fir 
itfi^. 

[0079] ( 4 ) ±l£HiiWT"{i, ^L7-?A«X 

Xh, oil) Srfflv^4ifc36*nrietr*4. 
[0ffi<^em^SiBB] 

[01 ] *«^8<0— Htt«T*4* ; Fa*>L<oa«>ii* 

[02] «^^L^«rta»«ia<orts&5?ta^ 
0. 

[03] m^Lmxtryy-yn-miEtiXx/^-^ 

[04] ^Lts$g£onrmg«ops*ftSr^-mBj0. 
[05] iTSiSs^uw^ra-ftsaacoisa^^^KB 
0. 

[06] •?-7Wi&jHizim<?mfrLmxizmmLtem 
[07] ^aa^L^feA^-^aw^K^s^r 

[08] HSgWcfctt^m^a^L^SrUfi 1 ^- 
[09] 3t*»L«OS*5iA«yScO#HI$-^t- 7Q- f-v 

-ho 

[W^i^BB] 

22-CPU 
24—^-f yx*:>J 

2 6 —•71'— A^'J 

3 0-#— H 
3 2—-7 t >X 

3 4-^^B 

3 8-tfA 

3 9-^^t 

4 0- /<X 

4 2-«^S*>L.ffii^a:^ 

4 4--m^^us-^a5 
4 6-a*>L^5i^ba5 
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(B) ®«'graphic B Cl>tr-6r>^-7a- 
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30.60% 


18.83% 
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12.00% 


0.3 
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1.73% 
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24.55% 
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33.78% 



[04] 



[09] 
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(A) BBttP 
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l &fetr*! a £S^1 A-l 



a^ufffd x <ta#Lffi x y- S3 
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££S&?Tfll A» MOT 

IT 



S4 
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[05] 



[06] 



[07] 



anas* L©**jsHtsui 



I, x 2 
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RGBgjflfc 





[H8] 
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CB) *M^Lco^:*6tO^-^m^K^2 




